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AUTOMATIC WINDOW REPRESENTATION ADJUSTMENT 
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BACKGROUND OF THE INVENTION 

1. Technical Field: 

The present invention relates in general to computer systems 
and, in particular, to graphical user interfaces. Still more 
particularly, the present invention relates to automatically 
adjusting window representations within a graphical user 
interface based on activity. 

2 . Description of the Related Art : 

Most operating systems provide a graphical user interface 
(GUI) for controlling a visual computer environment. The GUI 
represents programs, files, and options with graphical images, 
such as icons, menus, and dialog boxes on the screen. Graphical 
items defined within the GUI work the same way for the user in 
most software because the GUI provides standard software routines 
to handle these elements and report the user's actions. 

A typical graphical object defined by a GUI is a window or 
other defined area of a display containing distinguishable text, 
graphics, video, audio and other information for output. A 
display area may contain multiple windows associated with a 
single software program or multiple software programs executing 
concurrently. 

Often when multiple graphical objects are displayed 
concurrently, the graphical objects will overlap. The order in 
which graphical objects are drawn on top of one another onscreen 
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to simulate depth is typically known as the z-order. Typically , 
those objects at the top of the z-axis obscure the view of those 
graphical objects drawn below. 

A general limitation of z-ordered windows is that as more 
windows are opened within a display area, windows that are at the 
bottom of the z-order may not remain visible. A user may select 
to minimize particular windows into icons or as part of a 
selectable pop-up list, however performing such actions requires 
bringing the particular windows first to the top of the z-order. 

In some operating systems, a level of transparency or 
translucency may be applied to graphical objects, and in 
particular to windows. By applying a level of translucency to 
upper level windows, lower level windows are rendered visible 
through the upper level windows. Utilizing translucency is 
particularly advantageous such that multiple levels of windows 
within the z-order are visible at the same time. 

A particular limitation of applying translucency to windows 
is that some windows may become so transparent that the window is 
not longer visible. For example, U.S. Patent Application Serial 

No. / (Attorney Docket No. AUS920010516US1) describes 

adjusting the transparency of a window to reflect the resource 
usage associated with the window, sometimes leaving a window 
completely transparent and thus seemingly unavailable to the 
user. 

Therefore, in view of the foregoing, it would be 
advantageous to provide a method, system, and program, for 
automatically minimizing windows that have reached a particular 
level of activity, including use of the window, a transparency 
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applied to the window, and resource usage associated with the 
window. 
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SUMMARY OF THE INVENTION 

In view of the foregoing, it is therefore an object of the 
present invention to provide an improved computer system. 

It is another object of the present invention to provide an 
improved graphical user interface. 

It is yet another object of the present invention to provide 
a method, system and program for automatically adjusting window 
representations based on activity. 

According to one aspect of the present invention, current 
activity of a window element displayed within a graphical 
interface is detected. A representation of the window element is 
automatically adjusted within the display area to reflect current 
activity of the window element, such that the representation of 
the window element is graphically represented. In particular, 
the window element representation may include a minimized icon or 
an open window. Further, window element activity may include use 
of the window element, adjustments to the transparency of the 
window element representation or current resource usage 
associated with the window element. 

All objects, features, and advantages of the present 
invention will become apparent in the following detailed written 
description. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The novel features believed characteristic of the invention 
are set forth in the appended claims. The invention itself 
however, as well as a preferred mode of use, further objects and 
advantages thereof, will best be understood by reference to the 
following detailed description of an illustrative embodiment when 
read in conjunction with the accompanying drawings, wherein: 

Figure 1 depicts one embodiment of a computer system with 
which the method, system and program of the present invention may 
advantageously be utilized; 

Figure 2 illustrates a graphical representation of a user 
interface where windows are ordered according to recent usage in 
accordance with the method, system, and program of the present 
invention; 

Figure 3 depicts a graphical representation of a user 
interface in which representations of windows are adjusted 
according to recent use in accordance with the method, system, 
and program of the present invention; 

Figure 4 illustrates a graphical representation of a user 
interface in which the z-ordering of windows is controlled 
according to memory usage in accordance with the method, system, 
and program of the present invention; 

Figure 5 depicts a graphical representation of a user 
interface in which transparency is applied to adjust ordering of 
windows in accordance with the method, system, and program of the 
present invention; 



AUS920010521US1 



8 



Figure 6 illustrates a table of minimization and 
maximization representation preferences in accordance with the 
method, system, and program of the present invention; and 

Figure 7 depicts a high level logic flowchart of a process 
and program for adjusting window representations in response to 
window related activity in accordance with the method, system, 
and program of the present invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

A method, system, and program for automatically adjusting 
window representations based on activity are provided. In 
addition to windows, the representations of other displayable 
objects may be adjusted based on activity. Activity may include 
use of the window element, adjustments to the transparency of the 
window element representation or current resource usage 
associated with the window element. In addition, activity may 
include periods of inactivity. 

A "displayable object" may include text, icons, video, 
graphics, windows, or other logical graphical representations 
displayable within a display area. Displayable objects may be 
hidden or visible. Further, displayable objects may be layered 
in a z-order. Moreover, a displayable object may utilize a 
portion of a display area or may extend across the entirety of a 
display area. A displayable object may or may not include 
definable boundaries. 

For purposes of the present invention, a window 
representation is the current graphical display format of a 
window element. A window element is preferably the portion of 
data assigned to a particular window. Multiple applications, 
each defining at least one window element, may execute 
concurrently, where the representations of window elements from 
each of the multiple applications are also displayed 
concurrently. 

A z-order is the order along the z-axis in which displayable 
objects appear. Through a z -buffering technique, a depth is 
associated with each displayable object such that each object 
appears to be set at a particular depth in comparison with other 
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displayable objects. The z-order may be a result of the order in 
which a user opens displayable objects onto the display. 
Alternatively, according to one advantage of the present 
invention, a user may designate for the z-order to be set 
according to a particular criteria. 

Transparency is a graphical feature that is particularly 
advantageous to the present invention when displaying multiple 
displayable objects within a user interface where those 
displayable objects may overlap. As will be understood by one 
skilled in the art, by making a displayable object appear 
transparent on a computer screen, other displayable objects 
positioned below the transparent displayable object are rendered 
visible through the transparent displayable object. Further, the 
transparency of a displayable object may be adjusted from opaque 
to totally transparent. 

Typically, the transparency attribute is stored with color 
values in an alpha channel. Then, when calculating the 
appearance of a given pixel, the graphic processor uses the alpha 
channel values to determine the pixel's color through a process 
termed alpha blending. Through alpha blending, the process adds 
a fraction of the color of the transparent object set by the 
alpha channel value to the color of the displayable object below. 
Mixing the colors together gives the appearance that the 
displayable object below is seen through a layer of the 
transparent displayable object. In addition to alpha blending, 
additional shading may be added to create shadows and other 
graphical images to cue the viewer to the position of the 
transparent displayable object. 

In the following description, for the purposes of 
explanation, numerous specific details are set forth to provide a 
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thorough understanding of the present invention. It will be 
apparent, however, to one skilled in the art that the present 
invention may be practiced without these specific details. In 
other instances, well-known structures and devices are shown in 
5 block diagram form to avoid unnecessarily obscuring the present 
invention. 



HARDWARE OVERVIEW 



10 The present invention may be executed in a variety of 

systems, including a variety of computing systems and electronic 

Q devices under a number of different operating systems. In one 

■JJ! embodiment of the present invention, the computer system is a 

|;y! portable computing system such as a notebook computer, a palmtop 

15 computer, a personal digital assistant, a telephone or other 

ft! electronic computing system that may also incorporate 

p j5 communications features that provide for telephony, enhanced 

M 1 telephony, messaging and information services. However, the 

JJ! computer system may also be, for example, a desktop computer, a 

20 £3 network computer, a midrange computer, a server system or a 

ffij 

mainframe computer. Therefore, in general, the present invention 
is preferably executed in a computer system that performs 
computing tasks such as manipulating data in storage that is 
accessible to the computer system. In addition, the computer 
25 system preferably includes at least one output device and at 

least one input device. 

Referring now to the drawings and in particular to Figure 1, 
there is depicted one embodiment of a computer system with which 
30 the method, system and program of the present invention may 

advantageously be utilized. Computer system 10 comprises a bus 
22 or other communication device for communicating information 
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within computer system 10, and at least one processing device 
such as processor 12, coupled to bus 22 for processing 
information. Bus 22 preferably includes low-latency and high- 
latency paths that are connected by bridges and controlled within 
computer system 10 by multiple bus controllers. 

Processor 12 may be a general-purpose processor such as 
IBM's PowerPC™ processor that, during normal operation, processes 
data under the control of operating system and application 
software stored in a dynamic storage device such as random access 
memory (RAM) 14 and a static storage device such as Read Only 
Memory (ROM) 16. The operating system preferably provides a 
graphical user interface (GUI) to the user. In a preferred 
embodiment, application software contains machine executable 
instructions that when executed on processor 12 carry out the 
operations depicted in the flowcharts of FIG. 7 and others 
described herein. Alternatively, the steps of the present 
invention might be performed by specific hardware components that 
contain hardwire logic for performing the steps, or by any 
combination of programmed computer components and custom hardware 
components . 

The present invention may be provided as a computer program 
product, included on a machine-readable medium having stored 
thereon the machine executable instructions used to program 
computer system 10 to perform a process according to the present 
invention. The term "machine-readable medium" as used herein 
includes any medium that participates in providing instructions 
to processor 12 or other components of computer system 10 for 
execution. Such a medium may take many forms including, but not 
limited to, non-volatile media, volatile media, and transmission 
media. Common forms of non-volatile media include, for example, 
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a floppy disk, a flexible disk, a hard disk, magnetic tape or any 
other magnetic medium, a compact disc ROM (CD-ROM) , a digital 
video disc-ROM (DVD-ROM) or any other optical medium, punch cards 
or any other physical medium with patterns of holes, a 
programmable ROM (PROM), an erasable PROM (EPROM) , electrically 
EPROM (EE PROM) , a flash memory, any other memory chip or 
cartridge, or any other medium from which computer system 10 can 
read and which is suitable for storing instructions. In the 
present embodiment, an example of non-volatile media is storage 
device 18. Volatile media includes dynamic memory such as RAM 
14. Transmission media includes coaxial cables, copper wire or 
fiber optics, including the wires that comprise bus 22. 
Transmission media can also take the form of acoustic or light 
waves, such as those generated during radio wave or infrared data 
communications . 

Moreover, the present invention may be downloaded as a 
computer program product , wherein the program instructions may be 
transferred from a remote computer such as a server 39 to 
requesting computer system 10 by way of data signals embodied in 
a carrier wave or other propagation medium via a network link 34 
(e.g., a modem or network connection) to a communications 
interface 32 coupled to bus 22. Communications interface 32 
provides a two-way data communications coupling to network link 
34 that may be connected, for example, to a local area network 
(LAN) f wide area network (WAN) , or as depicted herein, directly 
to an Internet Service Provider (ISP) 37. In particular, network 
link 34 may provide wired and/or wireless network communications 
to one or more networks. 

ISP 37 in turn provides data communication services through 
the Internet 38 or other network. Internet 38 may refer to the 
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worldwide collection of networks and gateways that use a 
particular protocol, such as Transmission Control Protocol (TCP) 
and Internet Protocol (IP), to communicate with one another. ISP 
37 and Internet 38 both use electrical, electromagnetic, or 
5 optical signals that carry digital data streams. The signals 

through the various networks and the signals on network link 34 
and through communication interface 32, which carry the digital 
data to and from computer system 10, are exemplary forms of 
carrier waves transporting the information. 

10 

u Further, multiple peripheral components may be added to 

O computer system 10. For example, an audio output 28 is attached 
m to bus 22 for controlling audio output through a speaker or other 
T* audio projection device. A display 24 is also attached to bus 22 
15 SJ for providing visual, tactile or other graphical representation 
IM5 formats. Display 24 may include both non-transparent surfaces, 
O such as monitors, and transparent surfaces, such as headset 
pi; sunglasses or vehicle windshield displays. 

20 A keyboard 26 and cursor control device 30, such as a mouse, 

trackball, or cursor direction keys, are coupled to bus 22 as 
interfaces for user inputs to computer system 10. Keyboard 26 
and cursor control device 30 can control the position of a cursor 
positioned within a display area of display 24. It should be 

25 understood that keyboard 26 and cursor control device 30 are 

examples of multiple types of input devices that may be utilized 
in the present invention. In alternate embodiments of the 
present invention, additional input and output peripheral 
components may be added. 

30 



RECENTLY USED TRANSLUCENCY CONTEXT 
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Referring now to Figure 2, there is depicted a graphical 
representation of a user interface where windows are ordered 
according to recent usage in accordance with the method, system, 
and program of the present invention. As illustrated, a user 
5 interface 50 includes windows 52, 54, and 56. In the present 

example, window 52 is positioned at the top level of the z-order, 
followed in position by window 54, and then window 56. 

In the example, windows 52, 54, and 56 are open 
10 representations of window elements because the windows are 

displayed in an open window format. While in the present 
^ embodiment the sizes of the open representations are similar, in 
O alternate embodiments of the present invention, alternate sizes 

f : 5 s : j 

of open representations of window elements may be displayed. 

15 \jj 

^; In addition, in the example, windows 52, 54, and 56 are z- 

* ordered according to recent use, where the most recently used 

rf window is displayed as the top level of the z-order. While the 

ftJ z-order of windows traditionally reflects the order of recent 

20 % use, as will be further described, criteria for ordering windows 

ftp may be adjusted. 

A shadow 58 is applied to window 52 in order to distinguish 
that window 52 is displayed at the top level of the z-order. In 
25 alternate embodiments, additional shading may also be added to 

lower levels windows in order to further graphically distinguish 
the ordering of windows. 

In addition, adding shading to windows is particularly 
30 advantageous where transparency is applied to windows. Although 
not depicted, levels of transparency may be applied to each of 
windows 52, 54, and 56 to further distinguish the ordering of the 
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windows. For example, window 52 may be displayed at 0% 
transparency, while window 54 is displayed at 20% transparency 
and window 56 is displayed at 40% transparency. 

With reference now to Figure 3, there is illustrated a 
graphical representation of a user interface in which 
representations of windows are adjusted according to recent use 
in accordance with the method, system, and program of the present 
invention. 



As depicted, the window representation of window 56 is 
minimized. In the example, the minimized window representation 
of window 56 graphical represents that window 56 is the least 
recently used window. When determining recent use, the use of 
15 H windows with representations that are both open and minimized is 
preferably compared. 



jy In particular, where transparency is applied to window 

W representations in addition to or as an alternative to ordering, 

20 m the least recently window representation may become so 

transparent that visibility is limited. In that case, it is 
advantageous to automatically minimize the least recently used 
window representation to an icon or pop-up list, such that the 
screen space utilized to depict the least recently used window 

25 representation is minimized and the least recently used window 

representation is visible. Where multiple window representations 
are minimized, the minimized window representations are 
preferably further ordered to indicate recent usage. 



30 



Referring now to Figure 4, there is depicted a graphical 
representation of a user interface in which the z-ordering of 
windows is controlled according to memory usage in accordance 
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with the method, system, and program of the present invention. 
As illustrated, window 56 is depicted at the top level of the z- 
order, followed by window 52 and then window 54. 

According to one advantage of the present invention, windows 
may be z-ordered according to multiple criteria. Here, memory 
usage associated with each window is utilized as the z-ordering 
criteria, where the window utilizing the least memory is 
displayed at the top of the z-order. Therefore, according to the 
graphical display, a user may easily determine that NX appl #2" is 
utilizing the most memory of the application windows currently 
active . 

According to another advantage of the present invention, 
criteria may be designated for minimizing and maximizing window 
representations according to resource usage. Here, a criteria is 
designated to minimize the window with the greatest memory usage 
if the total memory usage is greater than 80% of the memory 
available. Therefore, the minimized representation of window 54 
indicates that window 54 utilizes the greatest memory usage where 
the total memory usage is greater than 80% of the memory 
available . 

In addition, a z-order chart 60 is provided as a tool for 
graphically designating the current criteria utilized to 
determine the z-order and the resulting order. Advantageously, 
multiple z-order charts, each utilizing independent criteria for 
ordering the windows, may be displayed concurrently, where upon 
user selection of one of the z-order charts, the windows are 
ordered according to that chart. 
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Further, levels of transparency are applied to each of the 
windows. Here, where window 56 is at the top of the z-order, 0% 
transparency is applied to the representation of window 56. 
However, window 52 is displayed at 40% transparency to indicate 
that window 52 is lower in the z-order than window 56. While the 
transparency applied to windows in the present example correlates 
with the z-order position of the windows, in alternate 
embodiments, the transparency of windows may be adjusted 
according to other criteria. 

With reference now to Figure 5, there is illustrated a 
graphical representation of a user interface in which 
transparency is applied to adjust ordering of windows in 
accordance with the method, system, and program of the present 



15 '^j invention. 

0 As illustrated, window 56 is assigned 0% transparency, 

ffj window 52 is assigned 30% transparency and window 54 is assigned 
% 95% transparency. According to the present example, transparency 
20 ftp assignments are made according to recent use of windows, such 

that most recently used windows are the least transparent and the 
least recently used windows are the most transparent. However, 
in alternate embodiments, alternate criteria may be designated 
for specifying transparencies of windows. In addition, a user 
25 may selectively adjust the transparency of a single window or 

multiple windows. 

According to one advantage of the present invention, 
criteria may be designated for minimizing and maximizing window 
30 representations according to transparency assignments of windows. 
In the example, a criteria is designated to automatically 
minimize windows with a transparency attribute greater than 90% 
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transparency. Here, window 54 is assigned a transparency 
attribute of 95%, leading to a minimized window representation. 
Advantageously transparency criteria may be further distinguished 
according to the type of window, the information contained within 
5 a window, or the type of software controlling the window. 

In addition, the windows are z-ordered according to CPU 
utilization. Z-order chart 62 indicates both the CPU utilization 
based ordering of the windows and the transparencies assigned to 
each window. Advantageously, through the use of z-ordering and 
10 transparency adjustment, window activity may be graphically 
5i described and distinguished. 

ITS Referring now to Figure 6, there is depicted a table of 

CO minimization and maximization representation preferences in 
15 vi accordance with the method, system, and program of the present 
Fte invention. As illustrated, a table 70 depicts transparency based 
p preferences 72, resource usage preferences 74, and general usage 

Jjg preference 76. 

? i 

20 Transparency based preferences 72 are first distinguished 

according to the type of software controlling the window. For 
each of the types of software controlling windows, further 
criteria is provided for minimizing and maximizing window 
representations. In addition, the criteria may be distinguished 

25 according to the type of window and the information contained 

within the window. Further, the criteria may be distinguished 
according to the criteria utilized to set the transparency for 
the window. 
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Resource usage preferences 74 are distinguished according to 
resource usage. In the examples, windows are minimized or 
maximized according to memory usage and sound card usage. In 
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addition, resource usage may include, but is not limited to 
graphics card usage, number of CPUs used, total usage of each 
CPU, number of threads used, data storage usage and net 
bandwidth. 

General usage preferences 76 are distinguished according to 
recent usage of windows. In the example, the least recently used 
application window is automatically minimized if the total number 
of windows active within the display area is greater than three 
windows, but less than nine windows. Then, the two least 
recently used applications windows are automatically minimized if 
the total number of windows active within the display area is 
nine windows or greater than nine windows. In addition, the 
third and fourth most recently used windows are automatically 
minimized, unless currently active. 

In addition to designating whether to minimize or maximize a 
window, a user may also specify attributes of the representation 
that is minimized or maximized. For example, when a window is 
being minimized, the user may specify whether the window 
representation is to be a selectable icon or part of a selectable 
pop-up list. Further, the transparency attribute, position, and 
other graphical characteristics may be designated. When a window 
is being maximized, the user may specify the size of the open 
representation, the position of the open representation, the 
transparency and hue of the open representation, and the z-order 
position of the open representation. 

With reference now to Figure 7, there is illustrated a high 
level logic flowchart of a process and program for adjusting 
window representations in response to window related activity in 
accordance with the method, system, and program of the present 
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invention. As depicted, the process starts at block 90 and 
thereafter proceeds to block 92. 

Block 92 illustrates monitoring current window activity 
5 including use, transparency attributes, and resource usage 

associated with windows that are currently displayed. Next, 
block 94 depicts a determination as to whether or not an 
adjustment in window activity is detected. If an adjustment in 
window activity is not detected, then the process passes to block 
10 92. If an adjustment in window activity is detected, then the 

c process passes to block 96. 

§>;!:: 
%ss; : 

O Block 96 depicts comparing the window activity with the 

ffj minimization and maximization representation preferences. Next, 



15 y* block 98 illustrates a determination as to whether or not any 



current window representations qualify for minimization or 
maximization. If no current window representations qualify for 
minimization of maximization, then the process returns to block 
92. If a current window representation qualifies for 



20 p minimization or maximization, then the process passes to block 

HI? 

100. Block 100 illustrates minimizing and maximizing the 
qualifying window representations according to representation 
preferences, and the process ends. 

25 While the invention has been particularly shown and 

described with reference to a preferred embodiment, it will be 
understood by those skilled in the art that various changes in 
form and detail may be made therein without departing from the 
spirit and scope of the invention . 
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